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Abstract. The following random process on Z 4 is studied. At first visit to a 
site, the two first coordinates perform a (2-dimensional) simple random walk 
step. At further visits, it is the last two coordinates which perform a simple 
random walk step. We prove that this process is almost surely transient. 
The lower dimensional versions are discussed and various generalizations and 
related questions are proposed. 



1. Introduction 

Excited random walk as denned by Benjamini and Wilson |BWj has a bias in 
some fixed direction, a feature which is highly useful in its analysis. See e.g. [MPRV 
and references within. Attempts to relax the dependence of the proof structure 
on monotonicity resulted in a number of works where the walker has competing 
drifts. See [ABK1 IKZ1 [H] . One motivation was to get closer to standard models 
of reinforced random walks on Z d , which are symmetric in nature. We think for 
instance on the question of recurrence vs. transience of 1-reinforced random walks, 
which is still widely open (see the surveys [MR] and [Pern] ). With the same goal 
in mind, we started exploring excited-like models where the walker is in addition 
also a martingale or a bounded perturbation of one, and posed some questions in 
2007 [K], which, it seems, are all still open. Progress on this kind of models was 
achieved in |KRS] . but there the laws were not nearest-neighbors. Here we describe 
and solve one such model of a nearest-neighbor walk in 4 dimensions. 

We describe a general form of the model in any dimension d > 2, but we will 
actually only deal with 4 dimensions here. So one has first to choose arbitrarily 
two integers d\ > 1 and d 2 > I such that d = d\ + d 2 ■ Then we define the process 
(S n , n > 0) on Z d as a mixture of two simple random walks in the following sense. 
Set S n = (X n ,Y n ), where X n g 1 dl is the set of the first d\ coordinates of S n 
and Y n £ Z d2 is the set of the last d2 coordinates. Now the rule is the following. 
First So = 0. Next if S visits a site for the first time then only the X component 
performs a simple random walk step, that is: 

V[S n+1 - S n = (0, . . . , 0, ±1, 0, . . . , 0) | F n ] = 1/(2^), 

where the ±1 can be at any of the first d\ coordinates. Otherwise, only Y performs 
a simple random walk step: 

V[S n+1 -S n = (0,..., 0, ±1, 0, . . . , 0) | JF„] = l/(2d 2 ), 

if S already visited the site S n in the past, where this time the ±1 can be at any 
of the last d 2 coordinates. We call this process S the M(di, ^-random walk. 

Here we say that a process is transient if almost surely any site is visited only 
finitely many times. It is said to be recurrent if almost surely it visits all sites 
infinitely often. We will prove the following, 

l 
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Theorem 1. The M (2, 2) -random walk is transient. 

The proof of Theorem [1] is elementary, and uses only basic estimates on the 
standard 2-dimensional simple random walk. It relies on finding good upper bounds 
for the probability of return to the origin and then use Borel-Cantelli Lemma (what 
makes however the proof nontrivial is that the two components X and Y are not 
independent). 

Note that the canonical projections of S on Z dl and Z d2 are usual (time changed) 
simple random walks. So if d — 4, and if d\ or di equals 3, then S is automatically 
transient, since the simple random walk on Z 3 is transient. Likewise if d is larger 
than 5, then for any choice of d\ and d2 (larger than 1), the resulting process will 
be transient. Thus the question of recurrence vs transience is only interesting in 
dimension less than 4. In dimension 3 there are two versions: d\ = 1 and d<i = 2 
or d\ = 2 and di = 1. We conjecture that in both cases S will be transient, also 
because it is a 3-dimensional process. Proving this seems nontrivial, but notice that 
a possible intermediate step between the dimension 3 and 4 could be to consider 
the analogue problem on the discrete 3-dimensional Heisenberg group, which is 
generated by 2 elements (and their inverses), yet balls of radius r has size order r . 

Let us make some comments now on the 2-dimensional case. As a 2-dimensional 
process, we believe that M (1, 1) is recurrent. Observe however that this is not true 
when starting from any configuration of visited sites. Indeed if we start with a 
vertical line of visited sites, then the process will be trapped in this line, and if 
the line does not include the origin, the process will not return there. It is also 
not difficult to construct starting environments such that the first coordinate of the 
process will tend almost surely toward +oo. For example if the initial configuration 
is the "trumpet" {(x,y) : \y\ < e x } then the walker will drift to infinity in the 
x direction^. Of course it is not possible for the random walk to create these 
environments in finite time, so it is not an obstacle for recurrence, but it may be 
interesting to keep this in mind. Another problem concerns the limiting shape 
of the range (i.e. the set of visited sites) of the process. Based on heuristics and 
some simulations, we believe that it is a vertical interval. This problem is closely 
related to the question of evaluating the size of the range R n at time n. Indeed 
the horizontal displacement of the process at time n is of order ^/^i? n , whereas its 
vertical displacement is always of order y/n. So another formulation of the problem 
would be to show that R n is sublinear. By the way we mention a related question. 
Assume that at each step, one can decide, conditionally on the past, to move the 
first coordinate or the second coordinate (and then perform a 1-dimensional simple 
random walk step). Then what is the best strategy to maximize the range? In 
particular is it possible for the range to be of size roughly n, or at least significantly 
larger than nj Inn, which is the size of the range of the simple random walk? 

A possible generalization of our model would be to consider multi-excited ver- 
sions, in the spirit of Zerner [Z]. In this case one should first decompose d as 
d = d\ + ■ ■ ■ + dm, for some m > 2 and di > 1, with i < m. Then at i th visit to a 
site only the z th component of S performs a simple random walk step, if i < m, and 
at further visits only the m th component moves. In dimension 4 for instance the 



We will not prove any of these claims, as they are somewhat off-topic 
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case di — 2 and efo = d% = 1 seems interesting and nontrivial. Another interesting 
case is d > 3 and di = 1 for each i < d (even the case d very large seems nontrivial). 

Another related problem is the following. Take two symmetric laws [i\ and \i<i 
on Z 4 . Decide that at first visit to a site the jump of the process has law fii, and 
at further visits it has law /x 2 . Then is it true that if the support of /ii and /i 2 both 
generate Z 4 , then the process is transient? 

Acknowledgments: This work was done while BS was a visitor at the Weizmann 
Institute and he thanks this institution for its kind hospitality. 

2. Proof of the theorem 
The theorem is a direct consequence of the following proposition. 
Proposition 1. There exists a constant C > such that for any n > 1, 

P[0e {£„,..., S 2 „}]<C 

Indeed assuming this proposition we get 

^P[0e{5 2t ,...,S 2W }]<+oo, 

fe>0 

and we can conclude by using the Borel-Cantelli lemma. So all we have to do is to 
prove this proposition. 

Proof of Proposition^ For any n > 1, denote by r n the cardinality of the range of 
S at time n. The next lemma will be needed: 

Lemma 1. For any M > 0, there exists a constant C > 0, such that 
P [n/(C\nn) 2 < r n < 99n/100] = 1 - o(n~ M ). 

Proof. Note first that for any k, if Sk and Sk+i were not already visited in the 
past, then Sk+2 = Sk with probability at least 1/4. In particular for any k, there 
is probability at least 1/4 that S is not at a fresh site at one of the time k, k + 1 
or k + 2. Then a standard use of the Azuma-Hoeffding inequality gives the desired 
upper bound on r n . 

We now prove the lower bound. Let c > be fixed. Let (U n ,n > 0) be a 
simple random walk on Z 2 . For any n > 1 and x £ Z 2 , denote by N n (x) the 
number of visits of U to x before time n. A simple and standard calculation (see 
e.g. |LL( Proposition 4.2.4]) shows that there exists a constant C > such that the 
probability to not visit x in the next n steps after a given visit is > Gj log n. Using 
the strong Markov property one gets that the probability to make k + 1 visits by 
time n is < exp(— Cfc/logn) and hence there exists some C' > depending on M 
such that 

P[N n (x) > C'(lnn) 2 ] = o^^ 2 ). 
Moreover since U makes nearest neighbor jumps, before time n it stays in a ball of 
radius n. Thus if N* = sxvp x N n {x), then 

P[N* > C'(lnn) 2 ] = n 2 x o(n- M - 2 ) = o( n - M ). 

Thus if r n> u is the size of the range of U at time n, we get 

P [r n ,u < n/(C'(lnn) 2 )] = o( n - M ). 



In In n 
Inn 
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Let's come back to the original process S — (X, Y) now. We just observe that at 
time n one of the X or Y component performed n/2 steps. Since each of these 
components is a simple random walk, we deduce from the previous estimate, that 
before time n, X or Y will visit at least n/(2C"(ln n) 2 ) sites, with probability at 
least l-o(n- M ). This gives the desired lower bound for r n and concludes the proof 
of the lemma. □ 

We can finish now the proof of Proposition [TJ As noticed in the introduction, 
observe that the X and Y components are time changed simple random walks. 
Specifically we have the equality in law: 



where U and V are two independent simple random walks on Z 2 (and where by 
abuse of notation we also denote by r k , the size of the range of the (U, V) process 
at fc-th' step). By using Lemma Q] and the independence of U and V, we get 



Thus Proposition Q] follows from the following lemma: 

Lemma 2. Let U be the simple random walk on Z 2 and let t £ [n/ (Inn) 3 , 2n] . 
Then 



Proof. This lemma is standard, but we give a proof for reader's convenience. First 
let | • | denotes some norm on R 2 . Since t > n/(hm) 3 , it is well known (see e.g. 



((X k ,Y k ), k > 0) = ((U(r k ), V(k - r k )), k > 0), 



P[0G {S n ,...,S 2n }] < P[0G {U(n/(C\nn) 2 ),...,U(2n)}] 

xP [0 e {y(n/10Q), . . . , V(2n)}] + o(n 



M 



(1) 






where P^ denotes the law of U starting from x and for any r > 0, 
T r = inf{fc > : r < \U{k)\ < r + 1}. 



But if \x\ > v^/Gnn) 3 , then nlnn = O {\x\(kx \x\) i ) and in particular (see e.g. 
(LLl Proposition 2.1.2]) 



Ph«|(l»|.|)« < 2n] =0{n- 1 ). 
Notice finally that if \x\ > y/n/(\nn) 3 , then 




The lemma follows by using the strong Markov property. 



□ 



The proof of Theorem [T] is now finished. 



□ 
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Remark. The proof shows actually that for any finite initial configuration of visited 
sites, M(2, 2) is transient. This is of course not always the case if this configuration 
is infinite. For instance if we decide that all sites of the form (0, 0, *, *) are already 
visited at time 0, then the X component will never move and M(2, 2) will not be 
transient. 
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